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APPARATUS FOR REMOTELY CONTROLLING COMPUTERS AND OTHER 
ELECTRONIC APPLL\NCES/ DEVICES USING A COMBINATION OF VOICE 
COMMANDS AND FINGER MOVEMENTS 



FIELD OF THE INVENTION 
The present invention pertains to apparatus for controlling computers and 
other electronic appliances/ devices, and more particularly to an apparatus that 
uses voice controls and finger movement to remotely control various devices. 

BACKGROUND OF THE INVENTION 

Computers are widely used throughout the world by businesses, schools, 
goverimients, and in homes. Conventional desktop computers are operated 
using a keyboard and mouse, wherein the keyboard is typically used to enter 
text and commands, and the mouse is typically used for cursor navigation on 
and graphic control of the computer screen. Although conventional keyboards 
and mouse are typically coupled to a computer via cables, wireless keyboards 
and wireless mouse which operate over infrared or radio frequencies are also 
used to operate computers. In addition, for laptop computers, alternative 
mechanisms for cursor navigation and graphic control of a screen such as 
touchpads, track balls, and pointer sticks have been designed. 

Conventional keyboards and mouse of the type just described all suffer 
from several drawbacks. Specifically, they must be used together in order to 
operate a computer. In addition, most keyboards and mouse must be used on a 
flat horizontal surface. Moreover, due to the small size and low resolution of the 



screens of both desktop and laptop computers, the user must be positioned in 
close proximiiy to the screen in order to view the information displayed thereon. 
Several recent advances in technology are changing the way conventional 
computers are used. First, the advent of voice recognition systems which enable 
5 a user to give commands to a computer to insert text into a software application 
by speaking into a microphone is eliminating the need for keyboards. Second, 
new ways of viewing computers are being developed which no longer require 
the user to be positioned close to a stationary screen. These include large, high- 
resolution, flat-panel displays which can be wall-mounted, and goggle and 
^ 10 monocle visors which are worn on the head. Nevertheless, both of these 
2i advances suffer from drawbacks. Specifically, computers using both voice 

pi recognition systems and high-definition large-screen, flat panel displays still 

require the use of a mouse for accurate cursor navigation and for graphic control 
f5 of the screen. In addition, a user must be positioned in a stationary upright 

0 15 position in order to use the computer, without being able to recline or otherwise 
move about a room. Another drawback is that conventional computers and voice 
recognition systems fail to provide a means for enabling a computer to 
distinguish between spoken commands that operate the computer or a software 
application, and spoken text that is to be inserted literally into a software 
20 application. It is therefore an object of the present invention to provide an 
apparatus for remotely controlling computers and other electronic 
appliances/ devices using a combination of voice commands and finger 
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movements, which apparatus does not require the use of either a keyboard or a 
mouse. 

SUMMARY 

5 An apparatus for remotely operating a computer using a combination of 

voice commands and finger movements. The apparatus includes a plurality of 
control elements in the form of touch-sensitive touchpads and/or motion- 
sensitive elements that are used to operate the computer and to move an on- 
screen cursor. At least one touchpad is used to selectively switch between a 
li 10 command-mode of operation in which a user can issue spoken commands for 
5 selecting applications and for instructing the computer, and a text-mode of 

21 operation in which the user speaks the text to be inserted into an application. 

The apparatus is ergonomically designed to enable it to be easily worn and to 
fi enable a user to operate a computer from a standing, sitting or reclining position. 

□ 15 The apparatus can be used to operate a computer for traditional computing 
purposes such as word processing or browsing the Liternet, or for other 
purposes such as operating electronic devices such as a television and/ or other 
household appliances, 

20 
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BRIEF DESCRIPTION OF THE DRAWINGS 
FIG. lA shows a top view of an exemplary embodiment of an apparatus 

for remotely controlling computers and other electronic appliances/ devices 

according to the present invention. 

FIG. IB shows a bottom view of the apparatus shown in FIG. lA, 

FIG. 2 shows a flowchart depicting the steps in using the present 

invention. 

DETAILED DESCRIPTION OF THE INVENTION 
FIG. 1 shows a top view of an exemplary embodiment of an apparatus 10 
for remotely operating computers and other electronic appliances/ devices using 
a combination of voice commands and finger movements according to the 
present invention. FIG. 2 shows a bottom view of apparatus 10. 

Apparatus 10 can be used together with voice recognition systems and 
large-screen, flat-panel displays that are included as part a computer network to: 
1) operate the computer as is traditionally done, e.g., to browse the Internet or 
edit a word processing document; 2) use the computer to operate a television; 
and/ or 3) use the computer to operate other electronic appliances/ devices. The 
use of voice recognition systems and large-screen, flat-panel displays enables a 
user to operate the computer from any position and without having to be in close 
proximity to the display, e.g., walking around a room, reclining on a chair, etc. 
The network can include a plurality of large-screen, flat-panel displays, wherein 



different rooms of a home or office have a display so that a user can operate the 
computer from such rooms. Apparatus 10 can also be used in conjunction with 
the network to operate heating/ air conditioning systems, security systems, etc. 

Apparatus 10 is comprised of three finger-shaped sleeves 12, 14 and 16 
which are coupled together and are designed to be worn like gloves around the 
thumb, index and middle fingers, respectively, of a person's hand. Sleeves 12, 14 
and 16 can be fabricated from any type of material and can be constructed in any 
pattern such as the mesh pattern shown in FIGS. lA and IB. Apparatus 10 can be 
fabricated to have any number of sleeves which can be worn on any number of 
fingers. Alternative embodiments of apparatus 10 can be fabricated to be worn 
on one or two hands and/ or on part of one or two arms. 

Apparatus 10 includes an on/off switch 18, a transmitter 20 for 
transmitting signals to the computer being operated, and a receiver 22 for 
receiving signals from such computer. Apparatus 10 includes a control element 
in the form of a touch-sensitive thumb touchpad 24, which when held against 
one of the plurality of other touch-sensitive touchpads 26, 28, 30, 32, or 34 
operates a computer as described below. The functions of a conventional mouse 
are performed by using touchpads 24, 26, and 36 shown in FIGS. 1 A and IB, and 
28 and 30 shown in FIG. IB to move a cursor on a computer screen used as the 
graphical interface for operating a computer. When thumb touchpad 24 is held 
against cursor activator touchpad 26, the cursor movement function on the 
screen is activated in the same manner that a cursor on a computer screen comes 



under the user's control when they place their hand on a conventional computer 
mouse. 

A motion-sensitive pointer 36 is positioned on thumb sleeve 12 and 
extends from the top of the first knuckle of the thumb to the tip of the thumb. 
5 Moving motion-sensitive pointer 36 while maintaining contact between thumb 
touchpad 24 and cursor activator touchpad 26 causes corresponding movement 
of the cursor on the computer screen in the same manner that a cursor on a 
display screen is moved by moving a conventional computer mouse on a mouse 
pad. 

10 When index finger touchpad 28 is tapped once against thumb touchpad 

24/ the object the cursor is pointing to on the computer screen at such time is 
activated in the same manner that an object is activated by clicking the left 
button of a conventional computer mouse. Tapping index finger touchpad 28 
twice against thumb touchpad 24 is the equivalent of double-clicking the left 

15 button of the mouse. If index finger touchpad 28 is instead held in continuous 
contact with thumb touchpad 24, moving motion-sensitive pointer 36 drags the 
object selected on the screen to a different screen location in the same manner 
that an object on a computer screen is selected and dragged by holding down the 
left button of a mouse on the object, dragging the object to a different screen 

20 location and then releasing the left mouse button. If index finger touchpad 30 is 
tapped against thumb touchpad 24, the options for the object selected by the 
cursor will be displayed in the same manner that the options for an object are 
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displayed on a computer screen by clicking the right button of a conventional 
mouse. 

A microphone 38 is embedded or otherwise coupled to thtunb sleeve 12 of 
apparatus 10. When thumb touchpad 24 is held against text-mode touchpad 32, 
5 the microphone is turned on and engaged in text-mode and any words or 
sounds spoken into microphone 38 by the user are inserted as text into the 
application displayed on the computer screen, such as inserting text into a word- 
processing document. When thumb touchpad 24 is held against command-mode 
touchpad 34/ the microphone is turned on and engaged in command-mode and 

10 any words or sounds spoken into microphone 38 by the user are interpreted by 
the computer as instructions to perform a certain task, such as deleting 
highlighted text or turning an appliance on or off. 

A speaker 40 is coupled to the end of middle finger sleeve 24 so that by 
placing the first joint of middle finger sleeve 16 near an ear and the tip of thumb 

15 sleeve 12 near their mouth, a user can use apparatus 10 as a telephone. A battery 
42 is affixed near the back of index finger sleeve 14 to provide electronic power 
to different components of apparatus 10. A scroll touchpad 44 for scrolling up 
and down the pages on a computer screen is coupled to the back of middle 
finger sleeve 16. When thumb touchpad 24 is moved up and down against scroll 

20 touchpad 44, a user can scroll up and down, respectively, through the pages 
displayed on the computer screen in the same manner that the recently 
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popularized scroll wheel of a conventional mouse enables a user to scroll up and 
down through the pages displayed on a computer screen. 

FIG. 2 shows a flowchart depicting the steps in using apparatus 10 to 
operate a computer. At step 1, a person places apparatus 10 on the thumb, index 
5 and middle fingers of one hand. At step % the user turns apparatus 10 on using 
on/ off switch 18. At step 3, the user touches thumb touchpad 24 to command- 
mode touchpad 34 to activate the command-mode operation of the computer. At 
step 4, the user issues a voice command to open a software application, e.g., 
Internet browser, word processing document, etc., to be used. At step 5, the user 

10 touches thumb touchpad 24 to cursor activator touchpad 26 to activate the 
cursor, and while touchpads 24 and 26 are in contact the user uses motion- 
sensitive pointer 36 to position the cursor on the computer screen where text is to 
be inserted. The user releases thumb touchpad 24 from cursor activator 
touchpad 26 when the cursor has been positioned where text is to be inserted. At 

15 step 6, the user touches thumb touchpad 24 to text-mode touchpad 32 to activate 
the text-mode operation of the computer. At step 7, the user speaks the text to be 
inserted into the application. At step 8, the user touches thumb touchpad 24 to 
activate the command-mode touchpad 34 to activate the command-mode 
operation of the computer and issues a voice command to close the application. 

20 At step 9, the user turns off on/ off switch 18 to turn off apparatus 10, At step 10, 
the user removes apparatus 10 from their fingers. Alternatively, the user need 
not remove apparatus 10, but can wear the same as a clothing accessory. 
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The various elements of apparatus 10, such as touchpads 24, 26, 28, 30, 32 
and 34, motion-sensitive pointer 36, microphone 38, speaker 40, battery 42 and 
scroll touchpad 44 can each be positioned on any one of sleeves 12, 14 or 16 such 
that the operable functions of apparatus 10 are implemented differently than in 
the manner described herein. For example, motion-sensitive pointer 36 can be 
implemented on index finger sleeve 14 rather than on thumb sleeve 12. In 
addition, apparatus 10 can be fabricated so that it automatically turns off if it is 
not used for a predetermined period of time. Also apparatus 10 can be fabricated 
to include a motion sensor enabling apparatus 10 to be turned on and off by the 
user snapping his or her fingers or in some other manner. 

Apparatus 10 is implemented using conventional hardware and/ or 
software which enables it to communicate with computers and other electronic 
appliances/ devices. Apparatus 10 is designed to operate computers using 
existing software operating systems, such as Microsoft® Windows®, and existing 
software applications, such as Microsoft® Word® or a web browser. A user may 
wear an additional amplification device on the body to amplify signals 
transmitted from or received by apparatus 10. Apparatus 10 can communicate 
with computers over any frequencies that permit wireless, remote 
communications, including infrared and radio frequencies. Alternatively, 
apparatus 10 can be coupled to the computer using a cable. Apparatus 10 can be 
used to simultaneously operate multiple computers and/ or appliances/ devices. 
Apparatus 10 can be used to operate computers and appliances/ devices as long 
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as the appropriate drivers and communication protocols are installed on such 
computers and appliances/ devices. 

Apparatus 10 can be used with headgear such as goggles, monocles and 
glasses that are worn on the head to operate a computer. Apparatus 10 can also 
be used with a stylus and touch-sensitive touch screen to operate a computer. 
Apparatus 10 can also be used as a game controller, and can include additional 
touchpads for playing games, hi addition, multiple persons each wearing a 
separate apparatus 10 can simultaneously play a game or jointly operate an 
application on the computer. 

The aforementioned components comprising apparatus 10 can be 
fabricated from any material, can be coupled to any one of sleeves 12, 14, and 16, 
and can be secured to apparatus 10 using any means. Numerous modifications 
to and alternative embodiments of the present invention will be apparent to 
those skilled to the art in view of the foregoing description. Accordingly, this 
description is to be construed as illustrative only and is for the purpose of 
teaching those skilled in the art the best mode of carrying out the invention. 
Details of the structure may be varied substantially without departing from the 
spirit of the invention and the exclusive use of all modifications which come 
within the scope of the appended claims is reserved. 
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CLAIMS 

What is claimed is: 

1/ An apparatus for controlling an electronic device, comprising: 

a plurality of finger-shaped sleeves that are coupled together and are each 

worn on a different finger of a hand, wherein at least one of the plurality of 

sleeves has at least one control element for operating an electronic device using 

finger movements. 

2. The apparatus according to Claim 1, further comprising a 
microphone coupled to one of the plurality of sleeves, wherein the electronic 
device is operated using a combination of finger movements and voice 
commands. 

3. The apparatus according to Claim 1, wherein the at least one 
control element is a touch-sensitive touchpad. 

4. The apparatus according to Claim 1, wherein the at least one 
control element is a button. 

5. The apparatus according to Qaim 1, wherein the apparatus 
operates the electronic device remotely* 
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6. The apparatus according to Claim 1, wherein the apparatus is 
coupled to the electronic device by a cable. 

7. The apparatus according to Claim 1, wherein the electronic device 
is a computer. 

8. The apparatus according to Claim 1, wherein the at least one 
control element is a motion-sensitive pointer for moving a cursor on a display 
device. 

9. The apparatus according to Claim 1, wherein the electronic device 
is used to operate a television. 

10. The apparatus according to Claim 1, wherein the electronic device 
is used to operate a household appliance. 

11. The apparatus according to Qaim 1, wherein the electronic device 
is used to operate a computer. 

12. The apparatus according to Claim 1, wherein the apparatus 
includes communication means and a speaker enabling the apparatus to be used 
as a telephone. 
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13. The apparatus according to Claim 1, wherein the apparatus 
includes a receiver for receiving electronic signals from the electronic device. 

14. The apparatus according to Qaim 1, wherein the apparatus 
includes a transmitter for transmitting signals to the electronic device. 

15. The apparatus according to Claim 5, wherein the apparatus 
operates at an infrared frequency. 

16. The apparatus according to Claim 5, wherein the apparatus 
operates at a radio frequency. 

17. The apparatus according to Claim 2, wherein the apparatus 
includes a text-mode touchpad for instructing a voice recognition system to 
interpret spoken words literally as text to be inserted into a software application 
displayed on a display device by speaking into the microphone. 

18. The apparatus according to Claim 2, wherein the apparatus 
includes a command-mode touchpad for instructing a voice recognition system 
to interpret spoken words as operating commands for the electronic device or a 
software application by speaking into the microphone. 
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19. The apparatus according to Claim 1, wherein the apparatus 
includes a cursor activator touchpad, whereby touching the cursor activator 
touchpad activates control of a cursor on a display device. 

5 20. The apparatus according to Qaim 19, wherein the apparatus 

includes a motion-sensitive pointer used to move the cursor on the display 
device. 

21. The apparatus according to Claim 1, wherein the apparatus 
10 includes a scroll touchpad for scrolhng up and down pages displayed on a 
display device. 

22 The apparatus according to Claim 1, wherein the apparatus can be 
used in conjunction with headgear to operate the electronic device. 

15 

23 The apparatus according to Qaim 1, wherein the apparatus can be 
used in conjunction with a stylus and a touch-sensitive touch screen to operate 
the electronic device. 




A method for remotely controlling a computer, comprising the step 



of: 



using an apparatus having a plurality of finger-shaped sleeves that are 
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coupled together and are each worn on different fingers of a hand, the apparatus 
having a microphone coupled to one of the plurality of sleeves, and the plurality 
of sleeves each having at least one control element for remotely operating an 
electronic device using a combination of finger movements and voice 
commands, 

25. The method according to Claim 24, wherein the apparatus 
transmits and receives signals at infrared frequencies. 

26. The method according to Claim 24, wherein the apparatus 
transmits and receives signals at radio frequencies. 

An apparatus for operating a computer, comprising: 
at least one finger shaped sleeve to be worn on a finger of a hand for 
remotely operating a computer using a combination of voice commands and 
finger movements, the sleeve including a microphone into which a user speaks 
voice commands and at least one control element for selectively switching 
between a text-mode of operation and a command-mode of operation. 

28. The apparatus according to Claim 27, wherein the user operates the 
computer in the command-mode to issue spoken commands to the computer by 
speaking into the microphone. 
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29. The apparatus according to Claim 27, wherein the user operates the 
computer in the text-mode to insert spoken text into an appUcation displayed on 
a display device by speaking into the microphone. 

5 

30. The apparatus according to Claim 27, wherein the user uses the at 
least one control element to activate control of a cursor on a display device. 

31. The apparatus according to Claim 30, wherein the user uses the at 
10 least one control element to move the activated cursor. 

32. The apparatus according to Claim 27, wherein the apparatus 
eliminates the need to use a keyboard to operate the computer. 

15 33. The apparatus according to Claim 27, wherein the apparatus 

enables a user to operate the computer from a reclining position. 

34. The apparatus according to Claim 27, wherein the apparatus 
enables a user to operate the computer from a seated position, 

20 

35. The apparatus according to Claim 27, wherein the apparatus 
enables a user to operate the computer from a standing position. 
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36. The apparatus according to Claim 27, wherein the apparatus can be 
used in conjunction with headgear to operate the computer. 

37. The apparatus according to Claim 27, wherein the apparatus can be 
used in conjunction with a stylus and a touch-sensitive touch screen to operate 
the computer. 

38. The apparatus according to Claim 27, wherein the apparatus is 
ergonomically designed to facilitate remote operation of the computer. 
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ABSTRACT 

An apparatus for remotely operating a computer using a combination of 
voice commands and finger movements. The apparatus includes a microphone 
and a plurality of control elements in the form of touch-sensitive touchpads 
5 and/ or motion-sensitive elements that are used to operate the computer and to 
move an on-screen cursor. At least one touchpad is used to selectively switch 
between a command-mode of operation in which the computer interprets 
spoken words as commands for operating the computer and any software 
applications being used, and a text-mode of operation in which the computer 

10 interprets spoken words literally as text to be inserted into a software 
application. The apparatus is ergonomically designed to enable it to be easily 
worn and to enable a user to operate a computer from a standing, sitting or 
reclining position. The apparatus can be used to operate a computer for 
traditional computing purposes such as word processing or browsing the 

15 Internet, or for other purposes such as operating electronic devices such as a 
television and/ or other household appliances. The apparatus eliminates the 
need for a keyboard and a mouse to operate a computer, hi addition, the 
apparatus can be used as a telephone. 
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